Nonequilibrium thermodynamics and Nose-Hoover dynamics 
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We show that systems driven by an external force and described by Nose-Hoover dynamics allow 
for a consistent nonequilibrium thermodynamics description when the thermostatted variable is ini- 
tially assumed in a state of canonical equilibrium. By treating the "real" variables as the system 
and the thermostatted variable as the reservoir, we establish the first and second law of thermody- 
namics. As for Hamiltonian systems, the entropy production can be expressed as a relative entropy 
measuring the system-reservoir correlations established during the dynamics. 



I. INTRODUCTION 

The thermodynamic description of a system out of 
equilibrium is based on the first and second law. The 
first law states that since energy is conserved, the change 
in the system energy is the sum of the energy added doing 
work on the system and the energy flowing into the sys- 
tem from the environment under the form of heat. The 
second law states that the change in system entropy is the 
sum of the entropy flow, a reversible term given by heat 
divided by temperature, and the entropy production, an 
always positive or zero irreversible term [l|-y] . During the 
last years, significant progress has been achieved in es- 
tablishing the relation between the nonequilibrium ther- 
modynamics description of a system and its underlying 
dynamics. The discovery of fiuctuation theorems, first 
for thermostatted deterministic dynamics y-|9| and then 
for stochastic [l0l - [l5j and Hamiltonian dynamics p6l - l23| , 
played an important role in this regard. For stochastic 
dynamics, this connection is nowadays well established 
and has given rise to the field of stochastic thermody- 
namics |24| - [28| . More recently, exact relations for the 
entropy production have also been obtained for Hamil- 
tonian dynamics when considering specific class of initial 
conditions |29l - [3^ . Some work in this direction has been 
done for thermostatted deterministic dynamics [33l - l35j . 

In this paper, we explicitly construct the thermody- 
namics description of a driven system with an underly- 
in g N ose-Hoover thermostatted deterministic dynamics 
[3, [Sa, I33 ■ Our result can be viewed as the analogue for 
Nose-Hoover dynamics of the recent result obtained in 
[32| for open systems described by Hamiltonian dynam- 
ics. A key point in establish this connection is to treat 
the thermostatted variable as the reservoir. Our sole as- 
sumption is that the initial probability distribution of the 
thermostatted variable be a canonical equilibrium one. 



In section |TI] we briefiy remind the key properties of 
Nose-Hoover dynamics. In section IIIII we operate the 
system- reservoir identification and in section ITVl we iden- 
tify heat and work to establish the first law of thermo- 
dynamics. In section |V] we identify entropy and entropy 
production to establish the second law of thermodynam- 
ics. In section IVII we discuss the connection between 
irreversible work and entropy production and in section 
IVIII we discuss the interpretation of entropy production 
in term of system-reservoir correlations. Conclusions are 
drawn in section I Villi 



II. NOSE-HOOVER DYNAMICS 

We consider a iV-particle system confined in a D di- 
mensional time dependent potential V {\{t) , {qi{t)}) in 
contact with a Nose-Hoover thermostat at temperature 
T [^, |3a,[33]- The coordinates and conjugate momenta of 
the particles are denoted by qi and Pi{l <i < DN) and 
the time dependence of the potential occurs through the 
driving parameter A. The equations of motion read: 



P^{t) = 



mi 
dV{X{t),{q,{t)}) 
^q^{t) 



C{t)p^{t) 



1 -^^ 2 
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(1) 



The dynamical variable C mimics a friction coefficient 
and a is a measure of the relaxation rate. Hereafter, we 
abbreviate the set of variables {qi,PiX} ^-^d {qi,Pi} by 
r and Ts respectively. 

Any probability distribution f{t,r{t)) on the phase 
space r, due to conservation, satisfies 
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As a result, from 



dt dt dV ' 



we get that 
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(3) 



(4) 



where A is the phase space compression factor. For 
Hamihonian dynamics, Liouvihe theorem imphes A = 0, 
but for the Nose-Hoover dynamics ([T]), the phase space 
compression factor is given by A = —DNC^{t). This 
means that any probabiUty distribution evolves in time 
according to 

/(i,r(t)) = e^^/o'^<(^)/(o,r(o)) (5) 

which also implies 

dT{t) = dr(0)e^-°^ /o ''<('') . (6) 

These two relations will often be used in what follows. 

III. SYSTEM BATH SEPARATION 

We are now going to consider that the Ts variables 
constitute the system, while C constitutes the reservoir. 
This is reasonable since Tg are the true physical variables 
while C is only an artificial variable introduced to mimic 
the effect of a reservoir on the system dynamics. As 
a result, we define the (reduced) system and reservoir 
probability distributions as 

(7) 
(8) 



fs{t,Ts{t))^ j dC{t)f{t,T{t)) 
Mt,m)^ [ dT,it)fit,Tit)) 



and the system and reservoir Hamiltonian as 



i/.(A,r,) = ^^ + y(A,te}) 



2mi 



HriC) 



ae 



(9) 



The system and reservoir canonical distributions are 
therefore defined as 

/f'^(A,r,)^ ' ^,^^ , /;<?(c) = ^ — .(10) 



Zs{\) 



Zj'f 



Note that /3 — {ki,T) ^ and that Z^ and Zs{X) are the 
system and reservoir partition functions 

Zs{X) = J dTse-^"^(^^^^^ , Zr=JdCe-^"^.in) 

We finally introduce the canonical distribution of the to- 
tal system 

r^(A,r) = -^^^j^ = /r(A,r,)/,^«(c), (12) 



associated to the system-reservoir Hamiltonian 

Ho{X,T)=Hs{X,rs)+Hr{0- (13) 



An important property of the canonical distribution (J12p 
is that it is invariant under the Nose-Hoover dynamics 
for constant value of the driving parameter A. Indeed, 
using dl]), we verify that F-^ — — A/^"^ and that, using 



© and (H, % 



dt 



0. 



IV. WORK AND HEAT 

We start by noting that under the Nose-Hoover dy- 
namics ([ij, the Hamiltonian p^ evolves according to 



dHo{X{t),r{t)) _dH,{X{t),Ts{t)) 



dt 



dX{t) 



X{t) - DNkbTCit). 
(14) 



This shows that even in absence of external driving, i.e. 
for a fixed value of A, the Hamiltonian ([T|) is not con- 
served. Since the work performed on the system by the 
external driving from to i is naturally defined as 

wmr} /-^ ag.(A(r),r,(r)) .^ ^ 

W[t,T,= dr — — At), (15 

Jo dX{T) 

using (|14p . we can express this work as 

+DNkbT I dsC(s), (16) 

where the energy change in the system and reservoir 
along the trajectory F reads 

Ai?Jt,F,] =i7,(A(i),F,(t)) -iJ,(A(0),F,(0)) 

AHr[tX]^Hr{(:t)-Hr{Co)- (17) 

Since the first law of thermodynamics should apply for 
the system energy 



AHs[t,T,]^W[t,Ts] + Q[tXl 
it becomes natural to define heat as 



(18) 



Q[t, C] = -AHr[t, C] - DNkbT [ drC(T). (19) 

In the following, the statistical average of a trajectory 
dependent quantity A[t, F(t)] will be denoted by 



x{t) = {x[t,r{t)])t 

dr{t)f{t,T{t))X[t,T{t)]. 



(20) 



V. ENTROPY AND ENTROPY PRODUCTION 



VI. IRREVERSIBLE WORK 



Our key assumption is that we are going to consider 
initial conditions of the form 

/(o,r(o)) = /.(o,r,(o))/;'(c(o)), (21) 

where /s(0, rs(0)) is an arbitrary system distribution and 
/^'^(C(O)) is the the canonical equilibrium distribution of 
the reservoir. 

The central result of this paper is that the entropy 
production is given by 



A,S{t) = kJ In 



/(i,r(t)) 



/,(t,r,(i))/.^«(C(i)) 



(22) 



Indeed, using ^ and p^ . we can express (1^ as 

XSit) = ASit) - A.Sit), (23) 

where the first term AS{t) — S{t) — 5(0) is the change 
in the system entropy expressed as the change in Shan- 
non entropy associated to the reduced system probability 
distribution 

sit) = -h fdr,{t)f,{t,r,{t))inf,{t,r,{t)), (24) 



and the second term is the entropy flow expressed as the 
heat p9|) divided by temperature 



A,S{t) = 



Q{t) 

T ' 



(25) 



The entropy production ()23p is always positive or zero 
since it can be rewritten as a relative entropy 

A,S{t) = hB[f{t,r{t))\\ut,Ts{t))f^^m)] > 0. 

(26) 

Properties of relative entropies are discussed in detail 
in [38|. The entropy production will be zero only when 
/(i,r(i)) = f,{t,Tsit))f^''{C{t)). It thus becomes clear 
that (|23|) constitutes the second law of thermodynam- 
ics stating that the change in the system entropy AS{t) 
is the sum of two contributions, the irreversible entropy 
production AiS(t) > and the reversible entropy flow 
due to heat exchanges Af,S{t) [l-Q. Because a relative 
entropy is a measure of how different two distributions 
are from each other, we get a appealing physical inter- 
pretation of entropy production as a measure of how dif- 
ferent the actual distribution f{t,T{t)) is from the prod- 
uct of the actual reduced probability distribution of the 
system and the equilibrium distribution of the reservoir. 
The sarne result has been found for Hamiltonian dynam- 
ics in [32]. Introducing the nonequilibrium free energy 



F{t) = Hs{t)-TSit) 



(27) 



and using (^51) , (1^ and the average of (IT51) , we can also 
express entropy production as 



We now consider the special case where the initial 
probability distribution of the system (f2T|) is the canoni- 
cal equilibrium distribution (jlOp . In this case it is inter- 
esting to compare the entropy production (|28|) with the 
irreversible work defined as 



Wd^ss{t) 



W{t) - AF^«(i) 



(29) 



where AF'"'{t) = F^'i{t) - F^^iO) is the change in the 
equilibrium free energy F^'^{t) = — /3^^ lnZs(A(i)). In- 
deed, using ^ and (IT5|) . we find that the irreversible 
work can be expressed as 

Wd^ss{t) ^ ktD[f{t,r{t))\\r{\{t),r{t))] >o, (30) 

and is thus a direct measure of the lag between the ac- 
tual and the canonical probability distribution in the join 
system-reservoir space. The same result was obtained in 
|3l| for Hamiltonian and stochastic dynamics. Closely 
related results have also been obtained for Hamiltonian 
dynamics in [23, |30| • We can now express the difference 
between irreversible work and entropy production as a 
relative entropy between the actual and the equilibrium 
system distribution 

Wd^ss{t) - A,S{t) = kbD[Mt,T,{t))\\f^'^{X{t),rs{t))]. 

(31) 

Due to the positivity of relative entropies we get the in- 
equality 



Wd^ssit)>A,Sit)>0, 



(32) 



which only becomes an equality when the final state of 
the system (at time t) is the canonical equilibrium dis- 
tribution. Using (l^5|) with ([50]) . we also find that the 
equilibrium free energy is the minimum of the nonequi- 
librium free energy 



Fit) > F^-^it). 



(33) 



VII. CORRELATION ENTROPY 



Using ([5|), we start by noting that the change in the 
total Shannon entropy 

Stotit) = -k,Jdr{t)f{t,T{t))lnf{t,r{t)) (34) 

is given by (S^, l39| 

AStotit) = -hDN [ ds(C(s)),. (35) 

JQ 

We define the correlation entropy as minus the mutual 
system-reservoir information, i.e. the difference between 
the Shannon entropy of the total system Stot {t) and the 



sum of the Shannon entropy of the system S{t) and of 
the reservoir Sr{t) 



production can be interpreted as minus the correlation 
entropy, i.e. as the mutual system-reservoir information. 



Sc{t) = Stotit) - S{t) ^ Sr{t). 



(36) 



For the initial conditions that we consider ([21]) . Sc{0) = 
and the correlation entropy at time t can be expressed as 
the relative entropy 

- Sc{t) ^ hB[f{t,T{t))\\fS,Ts{t))fr{m)\ > 0.(37) 

As suggested by its name, the correlation entropy mea- 
sures the amount of negative entropy stored in the 
system-reservoir correlations by the dynamics. The cor- 
relation entropy is related to the entropy production by 

5c(i)+A,5(i)-fcbD[/,(i,C(t))||/;«(i,C(0)] > 0,(38) 

which implies the inequality 

A,S'(t) > -Sc{t) > 0. (39) 

The equality is satisfied when the reservoir can be as- 
sumed at equilibrium at time t. In such case the entropy 



VIII. CONCLUSIONS 

We have shown in this paper that Nose- Hoover dynam- 
ics can be made fully consistent with thermodynamics 
for class of initial conditions of the kind (l?T|) . We iden- 
tified the microscopic expressions for heat, work, system 
entropy and entropy production and where able to estab- 
lish the first and second law of thermodynamics starting 
from the underlying dynamics. This work can be viewed 
as the analog for thermostatted deterministic dynamics 
of the recent results obtained for Hamiltonian dynamics 
in [34I. Our microscopic expression for entropy produc- 
tion in term of a relative entropy is reminiscent of results 
such as fH, [H, [H, m Si . 
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